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CHAPTER  1 


BACKGROUND 

INTRODUCTION 

In  September  1976,  a  thesis  prepared  by  Captain  Milton 
C.  Ross  and  Captain  Gerald  L.  Yarger,  titled  A  Parametric 
Costing  Model  For  Flight  Simulator  Acquisition  was  released. 
The  technique  of  parametric  estimating  involves  the  identi¬ 
fication  of  cost  variables  and  quantification  of  their  rela¬ 
tionship  to  cost  (16:19).  The  primary  purpose  of  this  re¬ 
search  was  to  formulate  a  parametric  cost  estimating  model 
for  specific  use  in  flight  simulator  acquisition  (14:11). 
The  authors  recommended  that  further  refinement  of  this 
parametric  costing  model  would  require  additional  validated 
data  and  removal  of  outmoded  data  (14:47).  Continual 
refinement  and  maintenance  of  this  model  has  not  been  per¬ 
formed  as  suggested  (19).  Because  maintenance  has  not  been 
performed,  it  is  hypothesized  that  the  model  is  no  longer 
valid. 

PROBLEM  STATEMENT 


The  model  using  the  original  data  base  is  no  longer  a 
valid  and  accurate  estimator  of  flight  simulator  first  unit 


OBJECTIVES 


The  objectives  of  this  research  are  to: 

1.  Create  a  valid  data  base  using  the  latest  avail¬ 
able  flight  simulator  cost  data  and  with  this  data  base  try 
to  validate  the  existing  model. 

2.  Assuming  the  existing  model  cannot  be  valida¬ 
ted,  create  a  new  parametric  cost  estimating  model. 

JUSTIFICATION 

There  is  a  general  perception  that  federal  projects  suf¬ 
fer  consistent  cost  overruns  (6:13).  The  General  Accounting 
Office,  in  its  most  recent  report  on  the  topic,  for  example, 
has  stated  that  for  Department  of  Defense  Acquisition  pro¬ 
grams  now  underway,  67  percent  are  already  overrun  by  more 
than  100  percent  (4:72).  In  general,  the  Air  Force  has  suf¬ 
fered  from  numerous  cost  overruns  of  various  degrees  (9). 
These  cost  overruns  are  a  result  of  many  factors. 

One  of  the  reasons  we  have  cost  overruns  on  our  DOD  pro¬ 
grams,  is  because  of  the  guidelines  our  cost  estimates  must 
follow  in  the  Conceptual  Phase  (i.e.,  minimum  inflation  es¬ 
timates,  etc.)  (12).  It  is  in  the  Conceptual  Phase  of  a 
program  where  the  initial  cost  estimate  is  made.  If  the 
actual  cost  of  a  program  after  it  has  been  designed,  devel¬ 
oped,  produced,  and  activated  exceeds  the  initial  estimate, 
then  a  cost  overrun  is  said  to  have  taken  place  (9). 
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A  second  factor  influencing  cost  overruns  is  poor  esti¬ 
mates  by  the  Air  Force  and  industry  of  task  magnitude  and, 
consequently,  the  cost  and  schedule  required  to  perform  the 
task  (3:8).  During  1978,  a  number  of  new  systems  were 
delivered  to  the  U.S.  Military  forces  by  major  defense  con¬ 
tractors.  On  the  average,  according  to  the  reports  submit¬ 
ted  to  Congress,  these  systems  were  delivered  in  about  one- 
third  more  time  then  had  been  anticipated  (4:55). 

Because  of  the  difficulty  of  accurately  estimating 
costs,  especially  at  points  in  the  acquisition  life  cycle 
(Conceptual  Phase)  where  adequate  technical  information  is 
not  available,  an  interactive  cost  estimating  process  is  the 
only  way  to  obtain  reasonably  valid  cost  estimates.  The 
most  promising  technique  is  parametric  modeling  (16:18-19). 

The  current  state  of  cost  estimating  for  flight  simula¬ 
tors  is  evidenced  by  the  fact  that  the  mean  of  all  estimates 
at  completion  (EACs)  has  exceeded  139  percent  of  target  cost 
(3:22).  What  this  means  is  that  on  the  average,  the  actual 
cost  of  a  flight  simulator  has  been  139  percent  of  the  esti¬ 
mated  cost  for  that  simulator.  Unreliable  cost  estimating 
for  flight  simulators  has  been  a  known  deficiency  since 
1973.  The  Air  Force  Systems  Command  (AFSC)  Management 
Effectiveness  Inspection  of  the  Deputy  for  Simulators  (3) 
produced  several  findings  related  to  cost  estimating. 
Neither  these  findings  nor  their  root  causes  are  new.  They 
were  first  reported  in  AFSC  IG  Report  PN  74-12,  26  November 
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1973  -  6  December  1973,  and  re-emphasized  by  the  USAF  IG 
January  -  May  1975,  Program  Managers  Advisory  Group  (PMAG) 
October  1976,  A P  Audit  Agency  (975-6)  August  1977,  and  the 
Defense  Audit  Service  (8AE-140)  October  1978.  Internal  ASD 
assessments  have  confirmed  the  situation.  ASD/AC  Review, 
Mr.  Thorpe,  May  -  July  1976,  ASD/AC  Review,  Mr.  Ritchey,  6 
May  1977,  ASD  Independent  Cost  Estimates  (ICE)  for  B-52/KC- 
135  Weapon  System  Trainer  (WST),  A-10  and  P-16  WST  all  docu¬ 
ment  cost  estimating  deficiencies. 

In  an  effort  to  upgrade  the  cost  estimating  capability 
for  flight  simulators,  Ross  and  Yarger  utilized  multiple 
regression  analysis  to  formulate  a  parametric  costing  model. 
During  model  development,  significant  cost  estimating  rela¬ 
tionships  (CERs)  were  found  to  exist  between  cost  and  simu¬ 
lator  system  characteristics.  The  authors  suggested  that 
continual  updating  and  collection  of  CER  data  would  be 
necessary  for  further  refinement  of  the  parametric  costing 
model  (14:47).  As  of  this  date,  refinement  to  this  model 
for  flight  simulators  has  not  taken  place.  This  model  was 
first  put  into  use  in  1978  by  the  Simulator  System  Program 
Office,  ASD.  This  was  done  in  an  effort  to  see  if  the  model 
had  a  practical  use  in  the  simulator  cost  estimating  envi¬ 
ronment.  The  model  was  tested  against  various  simulator 
programs  and  was  found  not  to  be  a  reliable  estimator  of 
flight  simulator  costs.  If  the  model  was  a  reliable  estima¬ 
tor  of  flight  simulator  costs,  it  would  be  maintained  and 
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utilized  in  the  Simulator  SPO  (19).  It  is  the  goal  o £  the 
current  research  to  revise  the  previously  developed  model 
into  a  practical  cost  estimating  tool. 


RESEARCH  HYPOTHESIS 


Since  the  objective  of  this  research  is  to  validate  the 

work  of  Ross  and  Yarger,  the  research  hypothesis  will  be  the 

same.  That  hypothesis  was: 

There  is  some  combination  of  the  following  flight 
simulator  characteristics  which  have  a  significant  re¬ 
lationship  to  simulator  first  unit  cost.  The  character¬ 
istics,  all  of  which  can  be  identified  in  the  conceptual 
stage  of  the  weapon  acquisition  process  are: 

1.  Computer  core  capacity 

2.  Computer  instruction  processing  speed 

3.  The  number  of  crew  stations 

4.  Motion  axes 

5.  Emergency  procedure  capability 

6.  Sensory  cues 

7.  Unit  weight 

8.  Rate  of  electrical  power  consumption 

9.  System  cooling  capacity  in  BTU/hour 

The  above  characteristics  are  defined  as  follows 
(14:13) : 


1.  First  Unit  Cost  -  This  was  the  cost  in  adjusted 
dollars  paid  by  the  USAF  for  the  first  operationally  in¬ 
stalled  unit  of  flight  simulator  systems.  Cost  to  the  USAF 
is  the  summation  of  cost  to  the  contractor  plus  profit  when 
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work  is  accomplished  by  private  contractor. 

2.  Computer  Core  Capacity  -  The  maximum  characters 
which  could  be  stored  in  memory. 

3.  Computer  Instruction  Processing  Speed  -  The  in¬ 
ternal  speed  of  transmitting  information  to  and/or  from  mem¬ 
ory.  Speed  was  measured  in  microseconds  (10~6  seconds). 

4.  Number  of  Crew  Stations  -  The  number  of  physical 
locations  in  the  simulator  system  which  could  be  manned  by 
flight  crew  members. 

5.  Degrees  of  Freedom  -  The  number  of  motion  axes 
or  motion  planes  available. 

6.  Sensory  Cues  -  The  number  of  general  flight  or 
aircraft  sensations  which  could  be  perceived  through  either 
sight,  hearing  or  sense  of  touch. 

7.  Weight  -  The  weight,  in  pounds,  of  the  simulator 
crew  station  including  motion  platform. 

8.  Rate  of  Power  Consumption  -  Kilowatts  of  elec¬ 
tricity/hour  required  to  maintain  normal  simulator  opera¬ 
tion. 

9.  Emergency  Procedures  -  The  total  number  of  emer¬ 
gency  procedures  and  malfunctions  simulatable. 

10.  Cooling  Capacity  -  The  cooling  capacity  re¬ 
quired  for  one  mission  simulator  expressed  in  BTU/hour. 
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CHAPTER  2 


METHODOLOGY 

OVERVIEW 

In  reference  to  the  previously  stated  dual  objectives 
(Chapter  1),  the  methodology  required  to  accomplish  those 
objectives  will  be  explained  separately.  First,  by  explain¬ 
ing  the  methodology  used  in  attempting  to  validate  the  cur¬ 
rent  flight  simulator  parametric  cost  estimating  model. 
Second,  by  explaining  the  methodology  used  in  updating  and 
creating  a  new  model,  since  the  current  model  was  not  demon¬ 
strated  to  be  valid. 

VALIDATION  OF  EXISTING  MODEL 

In  order  to  discuss  the  methodology  that  will  be  used  in 
validating  the  Ross-Yarger  model,  it  is  appropriate  to  first 
explain  its  original  formulation.  The  model  was  developed 
using  Least  Squares  Regression  Analysis.  This  was  based  on 
the  assumption  that  Regression  Analysis  can  be  used  as  a 
predictor  of  price  when  certain  system  characteristics  are 
known  (14:16).  The  Statistical  Package  for  the  Social  Sci¬ 
ences  (SPSS)  subprogram  Stepwise  Multiple  Regression  was 
utilized  because  numerous  variables  (flight  characteris¬ 
tics)  appeared  to  be  determinants  of  flight  simulator  costs. 
This  subprogram,  which  is  based  on  Gauss-Jordan  elimination. 
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dropped  from  the  model  those  characteristics  which  proved 
not  to  be  statistically  significant.  Therefore,  the  model 
was  developed  using  only  those  variables  which  were  statis¬ 
tically  significant  in  predicting  flight  simulator  first 
unit  cost. 

The  flight  simulator  characteristics  which  were  origi¬ 
nally  tested  in  formulating  the  model  have  already  been 
stated  in  the  research  hypothesis  presented  in  Chapter  1. 
The  flight  characteristics  which  were  found  to  be  statisti¬ 
cally  significant  and  the  linear  equation  which  expressed 
the  relationship  between  these  variables,  were: 

Y  3  System  first  unit  cost  (in  constant  year  dollars) 

*  System  cooling  capacity  in  BTU/hour 

X2  -  System  weight  in  pounds 

X^  *  System  degrees  of  freedom  for  the  motion  platform 

*4  a  System  emergency  procedures/malfunctions  simula- 
table 

E  *  Error  term  for  the  model 

Y  *  -28,274,648.96  +  50.19X!  +  369.26X2  +  4,003,544. 50X3 
+  35,232. 25X4  +  E 

The  dependent  variable,  Y,  represented  cost,  expressed 
in  constant  1975  dollars.  The  error  term,  E,  is  considered 
to  have  a  mean  value  of  zero  (14:41). 

In  order  to  validate  this  model,  it  was  necessary  to 
test  a  population  of  simulators  which  were  not  used  in  the 


original  formulation.  The  flight  simulators  which  will  be 
used  in  validating  the  current  model  did  not  exist  during 
model  formulation.  To  have  a  valid  comparator,  for  model 
validation  purposes,  it  is  necessary  to  use  simulator  pro¬ 
grams  in  which  actual  first  unit  costs  can  be  reasonably 
determined.  This  would  allow  a  comparison  between  estimated 
first  unit  costs  and  actual  first  unit  costs.  In  order  to 
have  a  reasonable  degree  of  confidence  toward  the  actual 
first  unit  cost,  a  program  will  only  be  used  if  it  is  at 
least  90%  complete.  The  formula  that  will  be  used  in  deter¬ 
mining  percent  complete  is  presented  as  follows: 

Budgeted  Cost  of  Work  Performed  (BCWP)  „  , 00 

Budget  at  Completion  (BAC) 

Where: 

Percent  Complete  -  This  is  the  relationship  of  the 
amount  of  budget  (WORK)  accomplished  to  date  (BCWP)  to  the 
amount  of  budget  (WORK)  planned  for  the  total  contract  (BAC) 
( 2: A-7 ) . 

Budgeted  Cost  of  Work  Performed  (BCWP)  -  The  earned  val¬ 
ue  of  work  performed  in  terms  of  the  original.  This  con¬ 
sists  of  the  sum  of  the  budgets  for  completed  level  of  ef¬ 
fort,  completed  apportioned  effort,  completed  work  pack¬ 
ages,  and  the  completed  portion  of  in-process  work  packages 
(2:H-8). 

Budget  at  Completion  (BAC)  -  The  summation  of  all  bud¬ 
gets  for  work  authorized  plus  the  amount  of  management  re- 
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serve  withheld  (2:H-8). 

The  data  for  BAC  and  BCWP  will  be  obtained  from  Cost 
Performance  Reports  (CPR)  and  Cost/Schedule  Status  Reports 
( C/SSR) .  These  reports  are  monthly  documents  which  are  re¬ 
quired  by  DOD  Directive  5000.1  (17)  and  DOD  Instruction 
7000.10  (18). 

As  stated  previously,  a  population  of  simulators,  not 
used  in  the  formulation  of  the  original  model,  was  used  to 
test  its  validity.  This  test  was  accomplished  by  entering 
this  population  of  new  flight  simulator  data  into  the  esti¬ 
mating  model  developed  in  the  original  thesis.  Based  on 
this  flight  simulator  data,  the  model  then  estimated  a  first 
unit  cost  that  could  be  compared  to  actual  first  unit  cost. 
If  the  difference  between  the  estimated  cost  and  the  actual 
cost,  as  a  percent  of  actual  cost,  was  at  an  acceptable 
level  for  upper  management  at  the  Simulator  System  Program 
Office,  then  the  model  would  be  considered  a  valid  predictor 
of  first  unit  costs. 


MODEL  FORMULATION 

DATA  BASE  SOURCES  AND  ASSUMPTIONS 

Since  the  original  model  could  not  be  validated,  a  new 
parametric  cost  estimating  model  was  formulated.  The  popu¬ 
lation  of  flight  simulators  used  as  data  sources  was  a  com¬ 
bination  of  the  data  used  in  formulating  the  original  model 
and  the  current  simulator  data  that  was  used  in  the  attempt 
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to  validate  the  original  model.  The  new  flight  simulator 
data  was  obtained  from  current  program  files  located  in  the 
Simulator  System  Program  Office. 

Several  assumptions  were  made  concerning  the  simulators 
used: 

1.  Even  though  the  individual  flight  simulators  simu¬ 
late  dissimilar  aircraft,  the  systems  themselves  were 
comprised  of  homogeneous  features  and  characteristics 
(14:15). 

2.  The  system  characteristics  from  the  data  base  will 
also  exist  in  simulator  systems  acquired  in  the  future 
(14:15). 

3.  All  data  gathered  is  assumed  to  be  accurate. 

4.  By  the  time  a  simulator  is  at  least  90%  complete, 
actual  first  unit  costs  can  be  accurately  projected 
based  on  the  following: 

a.  Major  system  characteristics  have  been  designed 
and  manufactured  to  specifications  which  are  no 
longer  subject  to  change. 

b.  Major  technical  difficulties  have  been  re¬ 
solved. 

5.  The  use  of  the  Office  of  the  Secretary  of  Defense 
(OSD)  Economic  Escalation  Index  will  correctly  adjust 
for  the  effects  of  inflation  over  time. 
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ADJUSTMENT  FOR  INFLATION 

In  order  to  place  total  system  costs,  for  all  simulator 
programs  used  in  the  present  research,  on  an  equal  monetary 
level,  an  adjustment  for  inflation  was  incorporated  into  the 
data.  The  adjustments  were  made  using  the  OSD  Economic  Es¬ 
calation  Index.  The  base  year  (index  value  of  100)  utilized 
was  1975.  Since  all  price  figures  utilized  in  the  original 
model  development  were  expressed  in  terms  of  1975  constant 
dollars,  all  new  programs  entering  the  data  base  were  also 
adjusted  to  1975  constant  dollars. 

GENERAL  MODEL  FORMULATION 

The  primary  objective  of  this  model  formulation  was  to 
develop  a  model  which  utilized  certain  simulator  flight 
characteristics  as  predictors  of  first  unit  costs.  Since 
regression  analysis  is  a  statistically  proven  method,  which 
establishes  a  functional  relationship  between  variables  in 
order  to  predict  the  value  of  one  on  the  basis  of  another  or 
ethers  (7:597),  this  procedures  was  used  for  model  develop¬ 
ment.  Specifically,  multiple  regression  analysis  was  used. 
This  was  based  on  the  assumption  that  more  than  one  flight 
characteristic  would  be  used  as  a  predictor  of  cost.  The 
Least  Squares  method  of  regression  analysis  provides  the 
best  unbiased  estimator  of  a  dependent  variable,  Y,  (7:601); 
and  therefore,  was  used  as  the  basis  for  the  multiple  re¬ 
gression  model.  The  multiple  regression  model  used  takes 
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the  general  form: 


Y  =■  B0  +  B,  X,  +  B~X-  +  .  .  .  +  B  .X  -  +  E 
0  11  2  2  p-lp-1 

where:  Y  was  the  dependent  variable  representing  system 


first  unit  cost 


Xi's  were  the  independent  variables  representing 
the  various  flight  characteristics 

Bi's  were  the  unknown  parameters  to  be  determined  by 
the  analysis 

E  was  the  error  term 


In  an  effort  to  improve  the  general  form  of  this  model, 
additional  forms  of  independent  variables  were  used.  In 
addition  to  the  simple  linear  terms,  this  model  formulation 
explored  quadratic  terms  and  all  possible  interaction  (cross 
product)  terms  as  potential  independent  variables.  The  log 
linear  model  form  was  also  examined,  representing  the  fol¬ 


lowing  model: 


Y 


B.  B 
B0X1  X2 


COMPUTER  SUPPORT 

Because  of  the  speed  and  accuracy  available  in  computer 
systems,  computer  support  was  utilized  for  the  regression 
analysis.  The  Statistical  Package  for  the  Social  Science 
(SPSS)  provides  users  the  ability  to  build  data  files,  and 
then  proceed  with  a  variety  of  statistical  procedures  using 
that  data  file  (5:vii).  The  Statistical  Package  for  the 
Social  Science  subprogram,  Stepwise  Multiple  Regression  was 


used  based  on  its  applicability  to  this  model  development. 


PROPOSED  MODEL  VALIDATION 

In  order  to  assess  model  validity,  various  statistical 
tests  were  performed.  These  tests  were  used  to  determine 
the  degree  to  which  the  independent  variables  predicted  the 
dependent  variable  accurately.  The  statistical  tests  used 
to  determine  model  validity  will  each  be  discussed  separate 

ly. 

COEFFICIENT  OF  DETERMINATION 

This  index  of  the  goodness  of  fit  was  used  to  examine 

the  degree  of  linear  statistical  relation  in  the  sample  data 

2 

(10:498).  This  coefficient  of  determination,  denoted  R  , 

has  values  between  zero  and  one,  where  zero  signifies  no 

linear  relation  and  one  signifies  a  perfect  linear  relation. 

2 

The  authors  of  the  original  model  used  an  R  value  of  0.70 
as  an  acceptable  level  for  the  purpose  of  establishing 
validity  (14:19).  In  an  effort  to  obtain  a  higher  degree  of 
confidence  in  the  validity  of  this  research  model,  an  ac¬ 
ceptable  level  was  set  at  0.95  to  establish  model  validity. 
Since  this  coefficient,  R  ,  is  generally  made  larger  when 
additional  independent  variables  are  added  to  the  model,  an 
adjusted  R  will  be  utilized  in  order  to  compensate  for  this 
effect  (10:499).  This  adjustment  will  be  made  by  employing 
the  following  formula: 
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o2  „  ,  n^l  ( SSE) 
a  A  n-p  ( SSTO ) 

where: 

SSE  =  Error  sum  of  squares 

SSTO  =  Total  sum  of  squares 

P  =  The  number  of  parameters  in  the  regression  func¬ 
tion 

n  =  The  number  of  observations 

F  TEST  FOR  REGRESSION  RELATION 

The  F  Test  was  employed  as  an  overall  test  for  goodness 
of  fit  of  the  regression  equation.  This  test  indicates 
whether  the  sample  of  observations  being  analyzed  has  been 
drawn  from  a  population  in  which  the  multiple  correlation  is 
equal  to  zero,  and  that  any  observed  multiple  correlation  is 
due  to  sampling  fluctuation  or  measurement  error  (9:335).  A 
95%  confidence  level  was  established  for  model  validation 
(14:20). 

PARTIAL  F-TEST 

The  individual  regression  coefficients  in  the  multiple 
regression  model  are  tested  to  determine  whether  or  not  any 
one  independent  variable  can  be  dropped  from  the  model 
(10:503).  A  95%  confidence  level  was  established  for  deter¬ 
mining  individual  independent  variable  statistical  signifi¬ 
cances. 
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TEST  FOR  ACCURATE  PREDICTION 

As  an  external  test,  good  research  practice  would  dic¬ 
tate  drawing  flight  simulator  programs  from  the  population 
and  omitting  these  programs  from  the  model  formulation  pro¬ 
cess.  These  omitted  programs  would  then  be  used  in  the 
developed  model  in  order  to  test  the  accuracy  of  the  model. 
Since  the  total  population  of  flight  simulator  programs  is 
relatively  small  (14),  all  programs  were  used  in  the  formu¬ 
lation  of  the  model. 

As  an  accurate  predictor  of  first  unit  cost,  a  predic¬ 
tion  interval  for  the  dependent  variable,  when  the  independ¬ 
ent  variables  were  at  specified  levels,  was  used  (10:504). 
The  prediction  interval  was  calculated  with  the  aid  of 
MULREG.  MULREG  is  a  computer  package  which  allows  the  user 
to  perform  multiple  regression  analysis  on  specified  varia¬ 
bles.  This  program  permits  calculation  of  a  point  estimate 
and  prediction  interval  based  on  specified  values  of  the  in¬ 
dependent  variables.  The  confidence  level  for  the  predic¬ 
tion  interval  was  set  at  95%. 

In  addition  to  using  a  prediction  interval  to  evaluate 
model  accuracy,  a  relative  error  calculation  was  made.  This 
calculation  examined  the  model's  accuracy  by  comparing  the 
prediction  error  as  a  percent  of  the  actual  first  unit  cost 
for  each  historical  data  point.  This  relative  error  was 
calculated  based  on  the  following  formula: 


Actual  First  Unit  Cost  -  Predicted  First  Unit  Cost  „  1Q0 
Actual  First  Unit  Cost 
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ADDITIONAL  TESTS 


As  in  the  original  research,  the  model  was  examined  for 
logical  consistency.  Specifically,  the  relationship  be¬ 
tween  the  dependent  variable  and  the  independent  variables 
was  assessed  to  make  sure  the  relationship  between  the  de¬ 
pendent  variable  and  the  independent  variables  appeared  log¬ 
ical. 
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CHAPTER  3 


DATA  BASE  COLLECTION 

SOURCES  OF  DATA 

The  data  base  for  this  thesis  effort  was  collected  from 
two  sources.  The  first  source  was  the  original  thesis 
(14:26,27).  The  second  source  of  data  was  flight  simulator 
programs  initiated  since  the  first  data  collection  effort  of 
Ross  and  Yarger.  The  new  data  was  limited  to  flight  simula¬ 
tor  programs  managed  by  the  Simulator  System  Program  Office 
(SPO),  located  at  Wr ight-Patterson  Air  Force  Base,  Ohio. 
Justification  for  this  limitation  is  that  the  prime  respon¬ 
sibility  for  all  new  aircraft  flight  simulators,  within  the 
Air  Force,  has  been  assigned  to  the  Simulator  SPO.  Two  ex¬ 
ceptions  to  this  have  been  the  E-3A  AWACS,  a  modified  ver¬ 
sion  of  the  C-135  aircraft,  and  the  E-4A  Airborne  Command 
Post,  a  modified  version  of  the  Boeing  747  aircraft.  Be¬ 
cause  these  were  modified  versions  of  existing  aircraft,  and 
also  because  the  data  was  not  easily  accessible,  these  two 
programs  were  not  used. 

The  bulk  of  the  technical  data  was  gathered  from  con¬ 
tractor  submitted  data  required  by  contract.  This  informa¬ 
tion  is  sent  to,  collected,  and  published  by  ASD/ENESS  (8). 
Other  data  sources  were  program  contract  files  and  numerous 
interviews  of  Aeronautical  Systems  Division  personnel,  in- 
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eluding  Milton  C.  Ross,  co-author  of  the  original  thesis. 

DATA  BASE  ADDITIONS 

Systems  that  were  considered  for  inclusion  in  the  data 
base  were  as  follows:  C-5A  Cockpit  Procedures  Trainer 

(CPT) ,  C-141  CPT,  P-5E,  C-130  Instrument  Flight  Simulator 
(IPS),  C-130  CPT,  B-52/KC-135  Weapon  System  Trainer  (WST) , 
and  the  F-16  WST.  Two  of  these  programs,  the  B-52/KC-135 
and  the  P-16  WST,  were  determined  unacceptable  for  inclusion 
in  the  data  base.  The  B-52/KC-135  WST  is  a  complex  type 
simulator  like  the  T-37/T-38  simulator  program  rejected  in 
the  original  thesis.  The  F-16  WST  was  rejected  from  inclu¬ 
sion  in  the  data  base  because  it  did  not  comply  with  the  90% 
completion  standard  stated  in  Chapter  This  system  was 

less  than  80%  complete  at  the  time  of  data  collection. 

DATA  COLLECTION  METHODS 

Data  was  gathered  from  various  sources.  Six  of  the  sim¬ 
ulator  characteristics  were  obtained  from  the  contractor 
submitted  data.  These  six  characteristics  are  as  follows: 
computer  core  capacity,  computer  processing  speed,  degrees 
of  freedom,  weight,  rate  of  power  consumption,  and  cooling 
capacity.  The  emergency  procedures  simulatable  character¬ 
istic  was  gathered  from  a  review  of  contracted  emergency 
specifications,  with  the  assistance  of  numerous  engineers 
assigned  to  the  various  flight  simulator  programs.  The  sen- 
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sory  cue  characteristic  was  deleted  from  model  considera¬ 
tion.  The  reason  for  this  deletion  will  be  explained  under 
the  Changes  to  the  Original  Data  Base  section  in  this  chap¬ 
ter.  The  number  of  crew  stations  characteristic  was  collec¬ 
ted  in  interviews  with  ASD/YWP  Financial  Management  person¬ 
nel.  Actual  first  unit  costs  were  collected  by  consulting 
contract  files,  ASD/YWK  contract  personnel,  and  ASD/YWP  Fi¬ 
nancial  Management  personnel.  All  cost  figures  were  collec¬ 
ted  in  terms  of  the  fiscal  year  in  which  they  were  contrac¬ 
ted  and  then  adjusted  to  constant  1975  dollars.  Constant 
1975  dollars  were  used  in  the  original  thesis,  and  the  new 
data  was  converted  to  this  base  for  consistency.  The  Secre¬ 
tary  of  Defense  Economic  Escalation  Index  was  used  for  the 
inflation  adjustment  process.  The  procedure  for  this  pro¬ 
cess  is  to  divide  the  actual  fiscal  year  cost  figure  by  the 
index  for  that  year  to  convert  the  fiscal  year  dollars  into 
the  1975  base  year  dollars.  This  index  is  listed  in  Table 
1. 

The  results  of  the  data  collection  process  are  shown  in 
Table  2.  This  table  lists  both  the  data  from  the  original 
thesis  and  the  new  data  gathered  during  the  latest  effort. 
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★NEW  PROGRAMS  ENTERING  THE  DATA  BASE. 


CHANGES  TO  THE  ORIGINAL  DATA  BASE 


During  the  course  o£  the  data  collection  process,  one  of 
the  persons  contacted,  for  a  personal  interview,  was  Mr. 
Milton  C.  Ross  (15).  The  primary  purpose  of  this  interview 
was  to  discuss  methods  and  procedures  used  in  the  original 
effort,  and  also  to  clarify  the  definitions  of  simulator 
flight  characteristics  used  for  the  creation  of  the  paramet¬ 
ric  cost  estimating  model.  A  major  problem  in  the  data  col¬ 
lection  process  was  interpreting  the  sensory  cue  definition. 
Since  this  definition  was  not  clearly  understood,  it  was 
presented  to  Mr.  Ross  for  further  clarification.  Even  with 
his  assistance,  this  characteristic  could  not  be  clearly 
defined  with  enough  confidence  to  assure  valid  data.  There¬ 
fore,  the  characteristic  was  eliminated  from  the  new  para¬ 
metric  cost  estimating  model  data  base. 

The  actual  first  unit  cost  of  the  F-15  was  another  data 
point  that  was  felt  to  be  suspect.  Mr.  Ross  stated  that  at 
the  time  of  the  data  collection,  the  F-15  was  a  new  system 
and  that  at  that  time  was  less  than  twenty  percent  complete. 

Because  the  development  costs  of  systems  grow  as  devel¬ 
opment  progresses,  as  a  result  of  government  and  contractor 
changes,  it  was  anticipated  that  the  actual  cost  of  the  F-15 
simulator  would  have  increased  since  the  original  data  col¬ 
lection.  It  was  therefore  decided  that  a  new  effort  would 
be  conducted  to  collect  the  actual  first  unit  cost  of  the  F- 
15  simulator.  The  method  used  was  the  same  as  the  procedure 
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used  to  collect  the  new  data,  with  the  assistance  of  P-15 
simulator  personnel  and  contract  files  (13). 

After  the  revision  of  the  F-15  cost  and  the  deletion  of 
the  sensory  cures,  the  complete  data  base  was  tabulated.  A 
visual  inspection  of  the  data  led  to  suspicion  of  other  fig¬ 
ures  in  the  old  data  base.  Primary  concern  focused  on  the 
weights  of  the  F-15,  F-111A,  and  FB-111A  flight  simulators. 
The  Orange  Book  (1)  was  reviewed  to  check  the  accuracy  of 
the  suspect  data.  This  data  was  found  to  be  in  error,  and 
therefore,  a  decision  was  made  to  verify  all  prior  data. 
The  verification  process  was  done  in  accordance  with  the 
same  procedures  used  to  collect  the  new  data.  From  the 
verification  process,  any  data  discrepancies  that  were  found 
were  corrected  to  reflect  the  actual  simulator  characteris¬ 
tics. 

DATA  FEATURES 

STRENGTHS 

The  data  was  perceived  to  possess  the  following 
streng ths: 

1.  There  appeared  to  be  no  bias  in  the  data  from  the 
sources  from  which  it  was  gathered. 

2.  A  major  source  of  the  data  collected  was  from  con¬ 
tractor  submitted,  Air  Force  Systems  Command  documents. 

3.  All  remaining  data  was  gathered  from  either  Air 
Force  contract  files  or  engineering  specifications. 


4.  All  data  is  objective  in  nature  and  stated  in  quan¬ 
tified  terms. 

5.  All  numerical  conversions  of  the  data  used  either 
established  scientific  conversion  factors  (e.g. ,  cool¬ 
ing  capacity  from  tons  to  BTU/hr.  )  or  Secretary  of 
Defense  published  rates  (e.g.,  inflation  index). 

WEAKNESSES 

1.  The  collection  of  the  flight  simulator  first  unit 
cost  -  Because  of  the  way  Air  Force  contracts  are  de¬ 
signed,  the  cost  collection  process  varied  from  program 
to  program.  This  resulted  in  cost  data  points  varying 
from  exact  cost  data,  at  time  of  collection,  to  collect¬ 
ing  costs  based  on  an  allocation  process.  Precise  cost 
data  was  collected  when  contracts  were  written  for  a 
single  flight  simulator  unit.  In  such  a  case,  all  con¬ 
tract  costs  are  for  the  procurement  of  that  single  unit. 
In  other  contracting  methods,  the  cost  data  is  not  as 
precise  and  has  to  be  estimated.  Such  is  the  case  when 
a  contract  is  written  for  more  than  one  simulator.  In 
one  contract  situation,  simulator  hardware  costs  are 
separated  by  contract  line  item  numbers,  but  costs  for 
other  items,  such  as  data  and  training,  are  consolidated 
under  one  contract  line  item  number  for  all  simulators 
contracted  for.  When  this  type  of  contract  was  encoun¬ 
tered,  total  simulator  costs  were  based  on  the  hardware 
costs  plus  a  percentage  of  the  simulator  costs  which 
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were  consolidated.  In  other  contracts,  written  for  more 
than  one  simulator,  all  simulator  costs  were  identified 
under  one  contract  line  item  number  for  all  simulators 
being  procured.  An  example  of  this  type  of  contract  was 
encountered  on  the  C-141  CPT  program.  In  this  contract, 
all  seven  units  procured  were  identified  on  contract 
line  item  number  one  and  all  data  costs  were  identified 
on  another  contract  line  item  number.  For  contracts 
written  in  this  manner,  flight  simulator  first  unit 
costs  were  determined  using  an  allocation  of  the  total 
contract  cost.  The  allocation  process  was  defined  with 
the  assistance  of  ASD/YWP  (Program  Control)  and  contrac¬ 
tor  submitted  cost  data.  Using  this  process,  recurring 
and  nonrecurring  costs  were  first  determined.  Once 
these  costs  were  determined,  nonrecurring  costs  plus  a 
percentage  of  the  total  recurring  costs  for  all  the  sim¬ 
ulators  were  added  together  to  reasonably  estimate  the 
simulator  first  unit  cost. 

2.  The  time  frame  of  the  data  base  -  The  data  collected 
ranges  from  programs  contracted  in  1962  to  programs  con¬ 
tracted  in  1978.  During  this  time  period,  there  were 
major  changes  in  technology,  especially  computer  tech¬ 
nology.  These  changes  could  have  an  effect  on  the  dev¬ 
elopment  of  a  powerful  CER.  Since  the  data  base  is 
small  (14  flight  simulator  programs),  it  was  decided  to 
use  all  programs  in  the  development  of  the  CER  even 
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though  it  would  encompass  changes  in  technology. 

3.  The  Maturity  of  the  Contract  -  As  long  as  a  flight 
simulator  contract  is  open,  it  is  subject  to  changes 
both  by  the  contractor  and  by  Air  Force  personnel.  Most 
contract  changes  are  directly  related  to  increased 
costs.  The  requirement  of  90  percent  completion,  im¬ 
posed  as  a  constraint  for  all  programs  entering  the  data 
base,  was  intended  to  make  all  flight  simulator  costs  as 
comparable  as  possible  in  relation  to  the  maturity  of 
the  contract.  But  until  a  unit  has  gone  through  both 
contractor  in-plant  test  and  Air  Force  on-site  tests, 
costs  can  grow  in  the  flight  simulator  program. 

4.  The  Comparability  of  the  Emergency  Procedures  Cha¬ 
racteristic  -  It  was  found  that  the  usefulness  of  the 
emergency  procedures  characteristic  was  questionable. 
This  characteristic  seemed  to  be  more  related  to  the 
number  of  engines  to  be  simulated,  per  aircraft,  than  to 
the  technology  required  to  develop  it.  The  reason  for 
this  was  that  a  multi-engine  aircraft  would  have  a  sep¬ 
arate  emergency  procedure  for  each  engine  malfunction 
(engine  fire,  low  oil  pressure,  etc.).  Each  malfunction 
would  require  only  one  software  program.  Therefore,  a 
C-130  flight  simulator  could  have  four  emergency  proce¬ 
dures  based  on  one  software  program  while  an  A-10  would 
only  have  two  for  the  same  malfunction. 
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SUMMARY 


The  CER  is  only  as  valid  as  the  data  used  in  its  devel¬ 
opment.  The  strengths  and  weaknesses  of  this  CER  were 
pointed  out  so  that  its  users  would  understand  the  source  of 
the  data.  Even  though  the  data  has  some  inherent  weaknes¬ 
ses,  the  data  base  appears  to  be  adequate  for  construction 
of  a  statistical  model  for  predicting  flight  simulator  first 
unit  cost. 
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CHAPTER  4 


PARAMETRIC  COSTING  MODEL  DEVELOPMENT 

Before  a  new  parametric  costing  model  could  be  formula¬ 
ted  it  was  necessary  to  assess  the  validity  of  the  model 
development  by  Ross  and  Yarger.  After  examining  the  data 
base  used  by  Ross  and  Yarger  and  testing  the  model  based  on 
the  criteria  defined  in  Chapter  2,  it  was  determined  that 
the  model  was  no  longer  valid.  This  assessment  was  based  on 
two  factors.  First,  the  data  used  in  developing  the  model 
was  not  considered  to  be  current.  This  determination  was 
based  on  the  various  updates  and  revisions  which  were  re¬ 
quired  on  the  original  data  base.  Since  the  quantitative 
values  of  characteristics  appearing  in  the  final  CER  were 
changed,  it  was  felt  that  the  Ross-Yarger  model  would  no 
longer  be  representative  of  the  current  data.  The  second 
factor  is  a  result  of  the  model  not  predicting  first  unit 
simulator  costs  within  acceptable  limits.  When  the  costs 
of  six  simulator  programs  (C-5  CPT,  C-141  CPT,  F-5E,  A-10,  C- 
130  IFS ,  C-130  CPT),  not  included  in  the  original  data  base, 
were  estimated  using  the  Ross-Yarger  model,  the  resultant 
average  relative  error  term  was  calculated  at  230.23%.  This 
relative  error  was  determined  to  be  excessive,  by  Simulator 
SPO  management  personnel,  for  the  purpose  of  predicting 
first  unit  simulators  costs.  The  results  of  estimating 
costs  for  these  simulator  programs  with  the  Ross-Yarger 


model  are  shown  in  Table  3.  Since  this  model  was  determined 
not  to  be  a  valid  predictor  of  first  unit  simulator  costs 
the  next  step  in  this  effort  was  to  develop  a  new  model 
based  on  an  updated  data  base  and  additional  modeling  meth¬ 
ods. 
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ACTUAL  VERSUS  ESTIMATED  COST 
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INITIAL  FORMULATION  AND  R2  TESTING 

The  first  step  in  developing  the  best  possible  model  was 
to  experiment  with  various  model  functional  forms  using  the 
SPSS  Stepwise  Multiple  Regression  procedure.  The  data  base 
consisting  of  the  fourteen  simulator  programs  was  input 
using  linear,  quadratic,  and  interaction  (cross  product) 
terms  as  possible  independent  variables.  A  log  linear  model 
form  was  also  tried.  The  selection  of  independent  variables 
for  the  various  model  forms  was  performed  using  either  the 
statistical  criteria  of  the  Stepwise  subprogram  or  by  forc¬ 
ing  specific  variables  into  the  model. 

Based  on  the  design  of  the  Stepwise  Multiple  Regression 
program,  there  is  no  certainty  that  the  program  will  gener¬ 
ate  the  best  possible  model.  The  option  to  force  variables 
into  the  model  permits  the  user  to  obtain  different  models 
which  may  have  more  intuitive  appeal  or  better  predictive 
properties.  Since  there  was  a  large  number  of  variables  and 
possible  variable  combinations,  it  was  not  feasible  to  try 
every  possible  combination  of  variables.  Variables  that 
were  examined  by  forcing  them  into  the  model  were  those 
which  had  a  high  correlation  with  cost,  but  did  not  enter 
the  model  when  variable  selection  was  based  totally  on  the 
statistical  selection  criteria  built  into  the  Stepwise  pro¬ 
cedure. 

The  Coefficient  of  Determination  (adjusted  R^)  was  use<j 
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as  the  initial  test  to  determine  whether  potential  models 

were  acceptable  for  this  effort.  As  stated  in  Chapter  2,  an 
2 

adjusted  R  of  .  95  or  higher  was  considered  acceptable. 
Table  4  lists  the  various  forms  in  which  the  subprogram  was 
run,  which  variables  were  forced,  and  the  adjusted  R  value. 
As  shown  in  Table  4,  only  one  model  had  an  acceptable  ad- 
justed  R  value.  Based  on  the  criteria  previously  defined, 
only  computer  run  number  6  required  further  statistical 
testing. 
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ADJUSTED  R  COMPUTER  RESULTS 
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Four  different  model  iterations,  calculated  under  com- 

2 

puter  run  number  six,  had  acceptable  adjusted  R  values. 
These  four  model  iterations  were  identified  as  iteration 
number  11,  12,  13,  and  14,  and  are  reproduced  in  Appendix  B. 
The  various  iteration  numbers  correspond  to  the  step  number 
given  on  the  computer  printout. 

The  next  step  in  model  development  was  to  test  the  four 
computer  iterations  using  an  overall  "F"  and  partial  "F" 
test.  The  overall  "F"  test  was  used  to  simultaneously  test 
all  the  independent  variables  in  relation  to  the  dependent 
variable.  The  partial  "F"  test  was  used  to  test  each  speci¬ 
fic  independent  variable  in  relation  to  the  dependent  varia¬ 
ble.  The  maximum  significance  level  specified  for  this  test 
was  .050.  Based  on  these  tests,  both  iterations  11  and  13 
were  deleted  from  further  model  consideration.  The  model 
represented  by  iteration  number  11  was  unacceptable  because 
the  partial  "F"  test  on  variable  KVA  was  not  significant. 
The  partial  "F"  value  for  KVA  was  .04367  with  a  critical  "F" 
of  4.21.  The  significance  of  this  variable  was  listed  at 
.841.  The  model  represented  by  iteration  number  13  was  also 
unacceptable  because  of  insignificant  partial  ”F"  tests. 
The  variables  COMCS  and  COMSSQ  had  partial  "F"  values  of 
.0257  and  3.441  respectively,  with  a  critical  "F"  of  4.21. 
All  variables  in  the  models  represented  by  iterations  12  and 
14  passed  the  partial  "F”  tests  and  are  shown  in  Table  5. 
Both  iterations  12  and  14  were  based  on  critical  "F"  of 
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3.87. 


PREDICTION  INTERVAL  AND  RELATIVE  ERROR 

All  test  results  to  this  point  had  shown  that  there  were 
only  two  acceptable  models,  but  no  determination  had  yet 
been  made  as  to  which  iteration  represented  the  better  mod¬ 
el.  Relative  errors  and  prediction  intervals  were  calcu¬ 
lated  to  help  determine  the  preferred  model.  Table  6  com¬ 
pares  the  relative  errors  for  iterations  12  and  14  for  each 
simulator  program.  The  mean  relative  error  for  the  itera¬ 
tion  12  model  was  11%  while  the  iteration  14  model  had  a 
smaller  mean  relative  error  of  only  8%. 

The  length  of  the  prediction  intervals  were  also  com¬ 
pared  in  choosing  the  preferred  model.  Table  7  shows  the 
two  iterations  with  the  prediction  interval  for  each  program 
and  the  width  of  each  interval.  The  mean  width  of  the  in¬ 
tervals  for  iteration  12  was  5,416,259.8.  The  mean  width  of 
the  intervals  for  iteration  14  was  4,326,263.4.  This  indi¬ 
cated  that  the  iteration  14  model  was  the  preferred  predic¬ 
tive  model. 


THE  SELECTED  MODEL 

Based  on  the  results  obtained  in  the  comparison  of  the 

I 

relative  errors  and  in  the  tightness  of  the  prediction  in¬ 
tervals,  the  selected  model  is: 


36 


Estimated  First  Unit  Cost  =  -7,392,616.9  +  158. 62858(BTU)  + 
. 0041279217 (WT) 2  -  .  0027478835 (WT X BTU)  -  1832959. 1 (DOF)  + 
11467. 699(DOF  X  KVA)  +  126625 . 02 ( COMS ) 2  +  E 
where: 

BTU  =  Cooling  Capacity  (BTU/hr) 

WT  *  Weight  (lbs) 

DOF  =  Degrees  of  Freedom 

KVA  =  Rate  of  Power  Consumption  (KVA/hr) 

COMS  =  Computer  Instruction  Processing  Speed  (10~6  sec¬ 
onds) 
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OVERALL  "F"  TEST  AND  PARTIAL  "F"  TEST 
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PREDICTION  INTERVAL  AND  WIDTH 
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CHAPTER  5 


MODEL  USAGE  AND  APPLICATION 

The  CER  developed  by  this  thesis  effort  should  be  used 
to  predict  the  first  unit  cost  of  a  USAF  flight  simulator. 
Flight  simulator  first  unit  cost  was  defined  as  total  equip¬ 
ment  costs  plus  Engineering  Change  Order  (ECO)  costs.  This 
first  unit  cost  also  includes  initial  AFSC  funded  support 
items  such  as  data  and  training,  but  does  not  include  Air 
Force  Logistics  Command  ( AFLC)  funded  support.  This  para¬ 
metric  cost  model  was  developed  using  cost  data  based  in 
fiscal  year  (FY)  1975  dollars.  All  estimates  from  this 
model  will  be  in  FY75  dollars,  therefore,  special  care 
should  be  taken  in  converting  the  FY75  dollars  to  the  appro¬ 
priate  year  dollars  desired.  Estimates  should  be  converted 
to  the  appropriate  year  dollars  using  the  latest  Secretary 
of  Defense  Economic  Escalation  Index. 

The  CER  is  used  by  entering  values  of  the  flight  charac¬ 
teristics  for  the  system  to  be  estimated  into  the  model. 
The  accuracy  of  the  model  will  be  partially  dependent  on  the 
accuracy  of  the  data  values  used  in  estimating  the  cost  of  a 
system.  It  is  therefore  suggested  that  special  care  be 
taken  in  obtaining  the  values  of  flight  characteristics  to 
be  used  in  this  CER.  Values  entering  the  model  should  be 
checked  for  consistency  and  reasonableness  in  relation  to 
existing  systems  in  the  data  base. 
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PREDICTIVE  RANGE 


Based  on  the  statistical  tests  performed  on  the  model 
and  examination  of  the  resultant  prediction  intervals,  it  is 
believed  a  strong  CER  has  been  developed  for  estimating 
flight  simulator  first  unit  costs.  Although  this  model  is 
believed  to  be  an  effective  estimating  tool,  care  should  be 
exhibited  when  using  this  CER  in  reference  to  the  technology 
base  and  complexity  of  the  simulator  for  which  cost  is  to  be 
estimated.  Attempts  to  estimate  the  cost  of  simulators 
which  will  be  advancements  in  the  state  of  the  art  or  which 
will  be  complex  systems,  such  as  those  excluded  from  the 
data  base,  could  impact  the  CER's  predictive  capability.  It 
is  recommended  that  serious  use  of  this  CER  be  limited  to 
those  simulators  which  are  from  the  same  technological  base 
as  those  simulators  in  the  current  data  base. 

CER  MAINTENANCE 

The  research  and  the  CER  developed  from  this  thesis  ef¬ 
fort  have  been  done  primarily  to  enhance  and  to  aid  the  cost 
estimating  capabilities  of  the  Program  Control  Division  of 
the  Simulator  System  Program  Office,  Aeronautical  Systems 
Division,  Air  Force  Systems  Command.  It  is  this  program  of¬ 
fice  that  has  the  primary  responsibility  for  the  acquisition 
of  aircraft  flight  simulators  for  the  Air  Force.  Since  this 
SPO  would  be  the  primary  users  of  this  CER,  it  should  be 
their  responsibility  to  provide  the  necessary  maintenance 
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and  upkeep  required  to  insure  continued  predictive  validity. 
Such  maintenance  would  require  the  collection  and  addition 
of  new  data  to  the  current  data  base  as  it  becomes  avail¬ 
able.  Updating  the  data  base  will  aid  in  keeping  the  CER 
within  the  scope  of  a  changing  technology.  As  changes  are 
made  to  the  existing  data  base,  the  coefficients  of  the  var¬ 
iables  and  the  variables  themselves  may  change.  Only  with 
continual  maintenance  and  upkeep  of  the  data  base  will  the 
CER  be  able  to  be  used  as  an  effective  tool  for  estimating 
flight  simulator  first  unit  cost  over  any  period  of  time. 

SUMMARY 

The  research  presented  in  this  thesis  was  initiated 
based  on  the  cost  estimating  relationship  developed  in  a 
masters  thesis  prepared  by  Ross  and  Yarger.  The  work  both 
by  Ross  and  Yarger  and  the  work  presented  in  this  thesis 
rely  on  the  assumption  that  a  CER,  for  flight  simulators, 
could  be  developed  based  on  simulator  system  characteris¬ 
tics.  The  primary  objective  of  this  effort  was  to  improve 
the  CER  developed  by  Ross  and  Yarger  by  updating  the  data 
base  and  by  using  additional  multiple  regression  techniques. 
It  was  found  that  by  increasing  the  data  base  (from  8  to  14 
observations),  and  by  using  quadratic  and  interaction 
(crossproduct)  terms  in  the  multiple  regression  analysis  a 
CER  could  be  developed  that  had  a  useful  predictive  range 
and  was  also  a  stronger  model  statistically.  The  model 
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developed  by  this  effort  is  applicable  to  those  systems 
which  are  from  the  same  technological  base  as  the  systems  in 
the  current  data  base.  As  was  suggested  by  the  earlier  ef¬ 
fort,  it  is  also  recommended  that  continual  updating  and 
maintenance  of  this  CER  be  performed  in  order  to  insure 
continued  model  validity. 
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APPENDIX  A 
VARIABLE  DEFINITIONS 
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COMPUTER  VARIABLE 


DEFINITION 


SIMPLE  LINEAR  TERMS 


COMC 

COMPUTER  CORE  CAPACITY 

COMS 

COMPUTER  INSTRUCTION 
PROCESSING  SPEED 

CREWST 

NUMBER  OF  CREW  STATIONS 

DOF 

DEGREES  OF  FREEDOM 

EPS 

EMERGENCY  PROCEDURES 

KVA 

RATE  OF  POWER  CONSUMPTION 

WT 

WEIGHT 

BTU 

COOLING  CAPACITY 

SOUARED  TERMS 

COMCSQ 

COMC  SQUARED 

COMSSQ 

COMS  SQUARED 

CREWSQ 

CREWST  SQUARED 

DOFSQ 

DOF  SQUARED 

EPSSQ 

EPS  SQUARED 

KVASQ 

KVA  SQUARED 

WTSQ 

WT  SQUARED 

BTUSQ 

BTU  SQUARED 

CROSS  PRODUCTS 

COMCS 

COMC  X  COMS 

COMCCRE 

COMC  X  CREWST 

COMC DOF 

COMC  X  DOF 

COMCEPS 

COMC  X  EPS 

COMCKVA 

COMC  X  KVA 

COMCWT 

COMC  X  WT 

COMCBTU 

COMC  X  BTU 

COMSCRE 

COMS  X  CREWST 

COMSDOF 

COMS  X  DOF 

COMSEPS 

COMS  X  EPS 
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COMSKVA 

COMS  X  KVA 

COMSWT 

COMS  X  WT 

COMSBTU 

COMS  X  BTU 

CREW DOF 

CREWST  X  DOF 

CREWEPS 

CREWST  X  EPS 

CREWKVA 

CREWST  X  KVA 

CREWWT 

CREWST  X  WT 

CREWBTU 

CREWST  X  BTU 

DOFEPS 

DOF  X  EPS 

DOFKVA 

DOF  X  KVA 

DOFWT 

DOF  X  WT 

DOFBTU 

DOF  X  BTU 

EPSKVA 

EPS  X  KVA 

EPSWT 

EPS  X  WT 

EPSBTU 

EPS  X  BTU 

KVAWT 

KVA  X  WT 

KVABTU 

KVA  X  BTU 

WTBTU 

WT  X  BTU 

LOG  LINEAR  TERMS 


LNCOMC 

LOG 

NORMAL 

COMC 

LNCOMS 

LOG 

NORMAL 

COMS 

LNCREW 

LOG 

NORMAL 

CREWST 

LNDOF 

LOG 

NORMAL 

DOF 

LNEPS 

LOG 

NORMAL 

EPS 

LNKVA 

LOG 

NORMAL 

KVA 

LNWT 

LOG 

NORMAL 

WT 

LNBTU 

LOG 

NORMAL 

BTU 
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